Pharmacoepidemiology 

introduction 

Study Design 

The research design refers to the overall strategy that you choose to 
integrate the different components of the study in a coherent and logical 
way, thereby, ensuring you will effectively address the research problem; 
it constitutes the blueprint for the collection, measurement, and analysis 
of data. 

A study design is a specific plan or protocol for conducting the study, 
which allows the investigator to translate the conceptual hypothesis into 
an operational one. 
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Conduct studies-related research for safety & efficacy using appropriate 
scientific principles in order to ensure optimal patient care. 

Retrieve information that addresses studies-related research for safety & 
efficacy inquiries in order to optimize patient care. 

Evaluate studies-related research for safety & efficacy literature, databases, 
and health information in order to translate findings into practice. 

Disseminate safety & efficacy -related information and/or research in order 
to educate health care professionals and trainees. 
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Validity in Study Design 
(Internal / External) 
Internal validity 

❖Validity within the confines of the study methods. 

❖Does the study design adequately and appropriately 
test/measure what it purports? 

❖Does the study adequately and appropriately address bias, 
confounding, and measurement of end points? 

External validity 

❖Validity related to generalizing the study results outside the 
study setting. 

❖Can the results be applied to other groups, patients, or 
systems? 

❖Addresses issues of generalizability and 
representativeness. 


Bias in Study Design 
1- Types of bias 

Selection bias 

An error in the selection of or sampling of individuals for a 
clinical study. Classic example: subjects chosen for the case and 
control groups differ in one or more characteristics that alter the 
outcome of a study 


Observational or information bias 

An error in the recording of individual factors of a study, such 
as inaccurate recording of a patient’s risk factor, inaccurate 
recording of the timing of a blood sample 


Recall bias 

Systematic error caused by differences in the accuracy or 
completeness of the recollections of study participants 
regarding past events or experiences 


Interviewer bias 


Classic example: Interviews are not conducted in a uniform 
manner (or by the same person) for all study participants. 

Misclassification bias 
(Differential - non differential) 

Patients classified to have disease but they doesn’t or vice versa. 



Diseased 

Not Diseased 

Exposed 

••••• 

••••ft. 
• ••• 


Not Exposed 

o.. •• .. 









Channeling or allocation bias 

When drug channeled to one group of people or away 
from another (severity of disease or comorbidities). 
Medication with similar therapeutic indications given to 
patients with different prognosis or risk levels. 

Immortal time bias 

Including person time in analysis when no outcome could 
have occurred. 

How to avoid Bias in Study Design 

Selection bias ==== randomization 
Or blinding 

Or inclusion / exclusion criteria 

Interviewer bias ==== use same interviewer in 2 groups 

Or using questionnaire 

Or same means of collecting data in 2 groups 

Recall bias ==== documentation 


Controlling bias before start of study is better than 
during study 




Causality in Study Design 


1. Temporality: Cause before effect 

2. Strength: Plausibility increases with strength of 
relationship 

3. Biological gradient: Dose-response? 

4. Consistency: Observations over several settings 

5. Specificity: Single cause for effect 

6. Plausibility: Biologically plausible 

7. Coherence: Consistency with existing knowledge 

8. Analogy: Preclinical expectation applied to 
clinical testing 

9. Experiment: Randomized controlled trials 


Prospective versus retrospective design 

Prospective: Begin in the present and progress 
forward, collecting data from subjects whose 
outcomes lie in the future. 

Retrospective: Begin and end in the present; 
however, this design involves a major backward 
look to collect information about events that 
occurred in the past. 


Evidence based medicine 



Figure 7: The three components of evidence-based medicine. 
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CASE REPORTS/CASE SERIES 


Document and Describe Experiences, Novel Treatments, and 
Unusual Events. Allows hypothesis generation that can be 
tested with other study designs. 

Possible adverse drug reactions in one or more patients: 
Example: QT-interval prolongation associated with 

fluoroquinolone antibiotics 


Case report: One patient 


Case series: More than one patient with a similar experience 
or many case reports combined into a descriptive review. 

Reports should provide sufficient detail to allow readers to 
recognize same/similar cases at their center/ practice. 

Advantages: Hypotheses are formed, which may be the flrst 
step in describing an important clinical problem. Easy to 
perform and inexpensive. 

Disadvantages: Does not provide explanation other than 
conjecture and does not establish causality or association. 


OBSERVATIONAL STUDY DESIGNS 
Case control - cohort - cross sectional 


1- Case control (Retrospective study) 

Design Does Not Involve Investigator Intervention, 
Only Observation. It is essential to remember that 
observational study designs investigate associations— 
not, in most cases, causes. 

Case-Control Study: Study Exposure in Those with 
and without the Outcome of Interest. 
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Figure 2. Case-control study design. 














Determine the association between exposures/risk 
factors and disease/condition. Classic example: 

Aspirin use and Reye syndrome. 

Study exposures in rare diseases or diseases that take 
long periods to develop 


Critical assumptions to minimize bias 

a. Cases are selected to be representative of those who 
have the disease. 

b. Controls are representative of the general population 
that does not have the disease and are as identical as 
possible to the cases, minus the presence of the disease. 

c. Information is collected from cases and controls in the 
same way. 


Measure of association : OR (odds ratio): In some cases, 
this can be an estimate of the relative risk/risk ratio 
(RR). The OR is interpreted as the odds of exposure to a 
factor in those with a condition or disease compared with 
those who do not have the condition or disease. 
Interpretation of these concepts will be presented below. 




Selection bias: Case selection and 
control matching are difficult 


2- Cohort study (Retrospective) 


Determines the association between exposures/factors and 
disease/condition development. 

Describes the incidence or natural history of a 
disease/condition and measures it in time sequence. 


Retrospective (historical): Begins and ends in the present 
but involves a major backward look to collect information 
about events that occurred in the past 

Measure Outcomes 
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Figure 3. “Retrospective" (historical) cohort study design. 
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Advantages: Less 
expensive and time- 
consuming; no loss to 
follow-up, ability to 
investigate issues not 
amenable to a clinical trial 
or ethical or safety issues 


Disadvantages: Only as 
good as the data available, 
little control of 
confounding variables 
through non statistical 
approaches, recall bias 
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3- Cohort study (Prospective) 

Prospective or longitudinal: Begin in the present and 
progress forward, collecting data from subjects 
whose outcomes lie in the future 
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Measure Outcomes 
Measure/Classify and Compare 



Figure 4. Prospective cohort study design. 


Measure of association: RR: The risk of an event or 
development of a condition relative to exposure; the risk of 
someone developing a condition when exposed compared 
with someone who has not been exposed. 

















4- Cross sectional study 

Identify the prevalence or characteristics of a condition in a 
group of individuals. 


Population-based, cross-sectional study: Prevalence of serious 
eye disease and visual impairment in a north London 
population. 


Cross-sectional analysis of data from a large cohort study: 
Maternal characteristics and migraine pharmacotherapy 
during pregnancy. 




Measurements 


Incidence - prevalence - relative risk RR - 
odd ratio OR - Relative risk reduction RRR 
Absolute risk reduction ARR - Number 
needed to treat NNN 

1- Incidence / Prevalence 
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2- Interpreting RR/OR 


Estimate the magnitude of association between exposure and 
disease. Key point: For observational studies, this is not cause 
and effect; it is an association. 

The incidence of disease in the exposed group divided by the 
incidence of disease in the unexposed group 


Table 3. Contingency Table for Estimating RR and OR 



Disease? 

Yes 

No 

Exposure? 

Yes 

A 

B 

No 

C 

D 


a. RR = 


A/(A+B) 

C/(C+D) 


A_ 

b. OR = 4- or = (AxD)(BxC) 
B 

'd 


Table 4. Contingency Table 



Disease? 

Hemorrhagic Stroke in Women 

Yes 

No 

Exposure? 

Appetite suppression use 

Yes 

6 

1 

No 

377 

749 


OR = (6.377) (1 749) = 12 

















3- Relative Risk Reduction 


Used to estimate percentage of base line risk that was removed or 
eliminated as a result of treatment or intervention. 

Used to make comparison between efficacy of experimental therapy to 
the control used 


RRR = (incidence in TXT - incidence in control) / incidence in control 
OR 

RRR = 1- RR 


4- Absolute Risk Reduction ARD 

Difference in risk of outcome between patients who received 
treatment and those of another treatment. 

ARR = event in TXT - event in control 


5- Number needed to treat NNT 

NNX = 1 / ARR the reciprocal of the absolute risk reduction. 

Applied in clinical outcome with dichotomous data (yes or no, alive or dead) 
Provided only for significantly effective trials 

Xell us how many patients needed to treat with the intervention in order to 
prevent an event which would otherwise occur. 


6- Interpretation of the index of risk 
Direction & Magnitude of risk 


Table 1. Direction of Risk Associated with OR and RR 


RR 

OR 

Interpretation 

<1 

<1 

Negative association 

RR: Risk of disease is lower in the exposed group 

OR: Odds of exposure is lower in the diseased group 

= 1 

= 1 

No association 

RR: Risk of disease in the two groups is the same 

OR: Odds of exposure in the two groups is the same 

>1 

>1 

Positive association 

RR: Risk of disease is greater in the exposed group 

OR: Odds of exposure is greater in the diseased group 


OR = odds ratio; RR = relative risk/risk ratio. 


Table 2. Magnitude of Risk Associated with OR and RR 


RR 

OR 

Interpretation 

0.75 

0.75 

25% reduction in the risk odds 

1.0 

1.0 

No difference in risk odds 

1.5 

1.5 

50% increase in the risk odds 

3.0 

3.0 

3-fold (or 200%) increase in the risk odds 


OR = odds ratio; RR = relative risk risk ratio. 















RANDOMIZED CONTROLLED TRIAL DESIGN 


(Causality not Association) 


Experimental or interventional, investigator makes intervention 
and evaluates cause and effect. 

Examine etiology, cause, efficacy, using comparative groups. 


Desisn allows assessment of causality. 

a. Sufficient cause 

b. Necessary cause 

c. Risk factor 


Treatment controls 

a. Placebo controlled 

b. Active controlled 

c. Historical control 


Minimizes bias through randomization and/or 

stratification 

a. Simple Randomization 

b. Block randomization 


c. Stratification 

d. Cluster randomization 








a. Simple Randomization 

Simple randomization is like flipping a coin, for example with 2 
treatment groups (control versus treatment), the side of the coin - 
control, and the other side - treatment. 


b. Block randomization 

Designed to randomize subjects into 2 groups that result in equal 
sample sizes - this method used to ensure balance in sample size 


c. Stratification 

Stratified method in randomization address the need to control 
and balance the influence of covariates 


d. Cluster randomization 

Group of subjects (as opposed to individual subjects) are 
randomized 


Blinding methods 

Single-blind - Double-blind - Triple-blind - Double-dummy - 
Open-label 


Single blind: Either subjects or investigators are unaware of 
subject assignment to active/control. 

Double blind: Both subjects and investigators are unaware of 
subject assignment to active/control. 

Triple-blind: Both subjects and investigators are unaware of 
subject assignment to active/control; in addition, an analysis 
group is unaware 

Double dummy: Two placebos necessary to match active and 
control therapies. 

Open-label: Everyone is aware of subject assignment to 
active/control. 


Factorial design: Designed to answer two separate research 

questions in a sinsle sroup of subjects 

Examples 

a. Clinical trial: Comparison of two drugs, comparison of two 
behavioral modifications, etc. 

b. Educational intervention: Online course versus lecture class format 

c. Health care intervention: Pharmacist-based health care team 
versus non-pharmacist-based health care team 





B. Randomized Controlled Trial: Parallel Design 
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Randomize 
and Allocate 




Measure Outcomes 
and Compare 




Figure 5. Randomized controlled trial: parallel design. 












C. Randomized Controlled Trial: Crossover Design 


Begin Randomize Measure Outcomes and Compare 



Figure 6. Randomized controlled trial: crossover design. 


Crossover provides practical and statistical efficiency. 

Crossover is not appropriate for certain types of treatment questions (e.g., effect 
of treatment on a disease that worsens quickly over time or worsens during the 
study period). 

Not appropriate for: drug modifying release - drugs with long half life - diseases 
with self limited period. 

















Examples of Considerations for Controlled Trials 
Are the results of the study valid (methods)? 

a. Did the subjects undergo randomization, and what was the 
randomization technique? Did the randomization process result in 
equal baseline characteristics? 

b. Were all subjects who entered the trial accounted for? Was follow¬ 
up complete? If not, how many were lost to follow-up, from which 
groups did they leave, and why? 

c. Were subjects analyzed in the groups to which they were 
randomized? Was intention-to-treat, per-protocol, or actual treatment 
analysis used? 

d. How was blinding conducted (e.g., subject, investigator), if 
applicable? 

e. Were the inclusion and exclusion criteria appropriate, or were they 
too restrictive or inclusive? 

Were the groups similar at the start of the trial? 

f. Was the sample size sufficient, and was a power calculation 
included? 

g. Were the groups handled the same way, aside from the 
intervention(s)? 

h. Were the statistical tests appropriate and understandable? 

i. What was assessed: Surrogate markers or true outcomes? Were a 
priori subgroup analyses performed? 



What were the results? 


a. How large was the treatment effect? 

b. How precise was the effect (based on CIs significant)? 


c. Did the authors properly interpret the results? 

3. Can I apply the results of this study to my patient population? Will 
they help me care for my patients? 

a. Can the results of this study be applied to general practice? 

b. Was a representative population studied? Can I apply this to my 
setting? 


c. Do the patients I care for fulfill the enrollment criteria for this 
study? 

d. Do the patients I care for fulfill the subgroup criteria evaluated? 


e. Do the expected benefits outweigh the expected and/or 
unanticipated risks? 








